Predicting response to neoadjuvant chemotherapy for colorectal liver metastasis using deep learning on prechemotherapy cross-sectional imaging.

BACKGROUND AND OBJECTIVES: Deep learning models (DLMs) are applied across domains of health sciences to generate meaningful predictions. DLMs make use of neural networks to generate predictions from discrete data inputs. This study employs DLM on prechemotherapy cross-sectional imaging to predict patients' response to neoadjuvant chemotherapy. METHODS: Adult patients with colorectal liver metastasis who underwent surgery after neoadjuvant chemotherapy were included. A DLM was trained on computed tomography images using attention-based multiple-instance learning. A logistic regression model incorporating clinical parameters of the Fong clinical risk score was used for comparison. Both model performances were benchmarked against the Response Evaluation Criteria in Solid Tumors criteria. A receiver operating curve was created and resulting area under the curve (AUC) was determined. RESULTS: Ninety-five patients were included, with 33,619 images available for study inclusion. Ninety-five percent of patients underwent 5-fluorouracil-based chemotherapy with oxaliplatin and/or irinotecan. Sixty percent of the patients were categorized as chemotherapy responders (30% reduction in tumor diameter). The DLM had an AUC of 0.77. The AUC for the clinical model was 0.41. CONCLUSIONS: Image-based DLM for prediction of response to neoadjuvant chemotherapy in patients with colorectal cancer liver metastases was superior to a clinical-based model. These results demonstrate potential to identify nonresponders to chemotherapy and guide select patients toward earlier curative resection.

Differential diagnosis of frontotemporal dementia subtypes with explainable deep learning on structural MRI.

Background: Frontotemporal dementia (FTD) represents a collection of neurobehavioral and neurocognitive syndromes that are associated with a significant degree of clinical, pathological, and genetic heterogeneity. Such heterogeneity hinders the identification of effective biomarkers, preventing effective targeted recruitment of participants in clinical trials for developing potential interventions and treatments. In the present study, we aim to automatically differentiate patients with three clinical phenotypes of FTD, behavioral-variant FTD (bvFTD), semantic variant PPA (svPPA), and nonfluent variant PPA (nfvPPA), based on their structural MRI by training a deep neural network (DNN). Methods: Data from 277 FTD patients (173 bvFTD, 63 nfvPPA, and 41 svPPA) recruited from two multi-site neuroimaging datasets: the Frontotemporal Lobar Degeneration Neuroimaging Initiative and the ARTFL-LEFFTDS Longitudinal Frontotemporal Lobar Degeneration databases. Raw T1-weighted MRI data were preprocessed and parcellated into patch-based ROIs, with cortical thickness and volume features extracted and harmonized to control the confounding effects of sex, age, total intracranial volume, cohort, and scanner difference. A multi-type parallel feature embedding framework was trained to classify three FTD subtypes with a weighted cross-entropy loss function used to account for unbalanced sample sizes. Feature visualization was achieved through post-hoc analysis using an integrated gradient approach. Results: The proposed differential diagnosis framework achieved a mean balanced accuracy of 0.80 for bvFTD, 0.82 for nfvPPA, 0.89 for svPPA, and an overall balanced accuracy of 0.84. Feature importance maps showed more localized differential patterns among different FTD subtypes compared to groupwise statistical mapping. Conclusion: In this study, we demonstrated the efficiency and effectiveness of using explainable deep-learning-based parallel feature embedding and visualization framework on MRI-derived multi-type structural patterns to differentiate three clinically defined subphenotypes of FTD: bvFTD, nfvPPA, and svPPA, which could help with the identification of at-risk populations for early and precise diagnosis for intervention planning.

Translating prognostic quantification of c-MYC and BCL2 from tissue microarrays to whole slide images in diffuse large B-cell lymphoma using deep learning.

BACKGROUND: c-MYC and BCL2 positivity are important prognostic factors for diffuse large B-cell lymphoma. However, manual quantification is subject to significant intra- and inter-observer variability. We developed an automated method for quantification in whole-slide images of tissue sections where manual quantification requires evaluating large areas of tissue with possibly heterogeneous staining. We train this method using annotations of tumor positivity in smaller tissue microarray cores where expression and staining are more homogeneous and then translate this model to whole-slide images. METHODS: Our method applies a technique called attention-based multiple instance learning to regress the proportion of c-MYC-positive and BCL2-positive tumor cells from pathologist-scored tissue microarray cores. This technique does not require annotation of individual cell nuclei and is trained instead on core-level annotations of percent tumor positivity. We translate this model to scoring of whole-slide images by tessellating the slide into smaller core-sized tissue regions and calculating an aggregate score. Our method was trained on a public tissue microarray dataset from Stanford and applied to whole-slide images from a geographically diverse multi-center cohort produced by the Lymphoma Epidemiology of Outcomes study. RESULTS: In tissue microarrays, the automated method had Pearson correlations of 0.843 and 0.919 with pathologist scores for c-MYC and BCL2, respectively. When utilizing standard clinical thresholds, the sensitivity/specificity of our method was 0.743 / 0.963 for c-MYC and 0.938 / 0.951 for BCL2. For double-expressors, sensitivity and specificity were 0.720 and 0.974. When translated to the external WSI dataset scored by two pathologists, Pearson correlation was 0.753 & 0.883 for c-MYC and 0.749 & 0.765 for BCL2, and sensitivity/specificity was 0.857/0.991 & 0.706/0.930 for c-MYC, 0.856/0.719 & 0.855/0.690 for BCL2, and 0.890/1.00 & 0.598/0.952 for double-expressors. Survival analysis demonstrates that for progression-free survival, model-predicted TMA scores significantly stratify double-expressors and non double-expressors (p = 0.0345), whereas pathologist scores do not (p = 0.128). CONCLUSIONS: We conclude that proportion of positive stains can be regressed using attention-based multiple instance learning, that these models generalize well to whole slide images, and that our models can provide non-inferior stratification of progression-free survival outcomes.

One label is all you need: Interpretable AI-enhanced histopathology for oncology.

Artificial Intelligence (AI)-enhanced histopathology presents unprecedented opportunities to benefit oncology through interpretable methods that require only one overall label per hematoxylin and eosin (H&E) slide with no tissue-level annotations. We present a structured review of these methods organized by their degree of verifiability and by commonly recurring application areas in oncological characterization. First, we discuss morphological markers (tumor presence/absence, metastases, subtypes, grades) in which AI-identified regions of interest (ROIs) within whole slide images (WSIs) verifiably overlap with pathologist-identified ROIs. Second, we discuss molecular markers (gene expression, molecular subtyping) that are not verified via H&E but rather based on overlap with positive regions on adjacent tissue. Third, we discuss genetic markers (mutations, mutational burden, microsatellite instability, chromosomal instability) that current technologies cannot verify if AI methods spatially resolve specific genetic alterations. Fourth, we discuss the direct prediction of survival to which AI-identified histopathological features quantitatively correlate but are nonetheless not mechanistically verifiable. Finally, we discuss in detail several opportunities and challenges for these one-label-per-slide methods within oncology. Opportunities include reducing the cost of research and clinical care, reducing the workload of clinicians, personalized medicine, and unlocking the full potential of histopathology through new imaging-based biomarkers. Current challenges include explainability and interpretability, validation via adjacent tissue sections, reproducibility, data availability, computational needs, data requirements, domain adaptability, external validation, dataset imbalances, and finally commercialization and clinical potential. Ultimately, the relative ease and minimum upfront cost with which relevant data can be collected in addition to the plethora of available AI methods for outcome-driven analysis will surmount these current limitations and achieve the innumerable opportunities associated with AI-driven histopathology for the benefit of oncology.

Predicting obstructive sleep apnea severity from craniofacial images using ensemble machine learning models.

Obstructive sleep apnea (OSA) is a prevalent disease affecting 10 to 15% of Americans and nearly one billion people worldwide. It leads to multiple symptoms including daytime sleepiness; snoring, choking, or gasping during sleep; fatigue; headaches; non-restorative sleep; and insomnia due to frequent arousals. Although polysomnography (PSG) is the gold standard for OSA diagnosis, it is expensive, not universally available, and time-consuming, so many patients go undiagnosed due to lack of access to the test. Given the incomplete access and high cost of PSG, many studies are seeking alternative diagnosis approaches based on different data modalities. Here, we propose a machine learning model to predict OSA severity from 2D frontal view craniofacial images. In a cross-validation study of 280 patients, our method achieves an average AUC of 0.780. In comparison, the craniofacial analysis model proposed by a recent study only achieves 0.638 AUC on our dataset. The proposed model also outperforms the widely used STOP-BANG OSA screening questionnaire, which achieves an AUC of 0.52 on our dataset. Our findings indicate that deep learning has the potential to significantly reduce the cost of OSA diagnosis.

Dynamic 2-deoxy-D-glucose-enhanced multispectral optoacoustic tomography for assessing metabolism and vascular hemodynamics of breast cancer.

Clinical tools for measuring tumor vascular hemodynamics, such as dynamic contrast-enhanced MRI, are clinically important to assess tumor properties. Here we explored the use of multispectral optoacoustic tomography (MSOT), which has a high spatial and temporal resolution, to measure the intratumoral pharmacokinetics of a near-infrared-dye-labeled 2-Deoxyglucose, 2-DG-800, in orthotropic 2-LMP breast tumors in mice. As uptake of 2-DG-800 is dependent on both vascular properties, and glucose transporter activity - a widely-used surrogate for metabolism, we evaluate hemodynamics of 2-DG-MP by fitting the dynamic MSOT signal of 2-DG-800 into two-compartment models including the extended Tofts model (ETM) and reference region model (RRM). We showed that dynamic 2-DG-enhanced MSOT (DGE-MSOT) is powerful in acquiring hemodynamic rate constants, including Ktrans and Kep, via systemically injecting a low dose of 2-DG-800 (0.5 µmol/kg b.w.). In our study, both ETM and RRM are efficient in deriving hemodynamic parameters in the tumor. Area-under-curve (AUC) values (which correlate to metabolism), and Ktrans and Kep values, can effectively distinguish tumor from muscle. Hemodynamic parameters also demonstrated correlations to hemoglobin, oxyhemoglobin, and blood oxygen level (SO2) measurements by spectral unmixing of the MSOT data. Together, our study for the first time demonstrated the capability of DGE-MSOT in assessing vascular hemodynamics of tumors.

NRK-ABMIL: Subtle Metastatic Deposits Detection for Predicting Lymph Node Metastasis in Breast Cancer Whole-Slide Images.

The early diagnosis of lymph node metastasis in breast cancer is essential for enhancing treatment outcomes and overall prognosis. Unfortunately, pathologists often fail to identify small or subtle metastatic deposits, leading them to rely on cytokeratin stains for improved detection, although this approach is not without its flaws. To address the need for early detection, multiple-instance learning (MIL) has emerged as the preferred deep learning method for automatic tumor detection on whole slide images (WSIs). However, existing methods often fail to identify some small lesions due to insufficient attention to small regions. Attention-based multiple-instance learning (ABMIL)-based methods can be particularly problematic because they may focus too much on normal regions, leaving insufficient attention for small-tumor lesions. In this paper, we propose a new ABMIL-based model called normal representative keyset ABMIL (NRK-ABMIL), which addresseses this issue by adjusting the attention mechanism to give more attention to lesions. To accomplish this, the NRK-ABMIL creates an optimal keyset of normal patch embeddings called the normal representative keyset (NRK). The NRK roughly represents the underlying distribution of all normal patch embeddings and is used to modify the attention mechanism of the ABMIL. We evaluated NRK-ABMIL on the publicly available Camelyon16 and Camelyon17 datasets and found that it outperformed existing state-of-the-art methods in accurately identifying small tumor lesions that may spread over a few patches. Additionally, the NRK-ABMIL also performed exceptionally well in identifying medium/large tumor lesions.

DNA-caged nanoparticles via electrostatic self-assembly.

DNA-modified nanoparticles enable DNA sensing and therapeutics in nanomedicine and are also crucial for nanoparticle self-assembly with DNA-based materials. However, methods to conjugate DNA to nanoparticle surfaces are limited, inefficient, and lack control. Inspired by DNA tile nanotechnology, we demonstrate a new approach to nanoparticle modification based on electrostatic attraction between negatively charged DNA tiles and positively charged nanoparticles. This approach does not disrupt nanoparticle surfaces and leverages the programmability of DNA nanotechnology to control DNA presentation. We demonstrated this approach using a vareity of nanoparticles, including polymeric micelles, polystyrene beads, gold nanoparticles, and superparamagnetic iron oxide nanoparticles with sizes ranging from 5-20 nm in diameter. DNA cage formation was confirmed through transmission electron microscopy (TEM), neutralization of zeta potential, and a series of fluorescence experiments. DNA cages present "handle" sequences that can be used for reversible target attachment or self-assembly. Handle functionality was verified in solution, at the solid-liquid interface, and inside fixed cells, corresponding to applications in biosensing, DNA microarrays, and erasable immunocytochemistry. These experiments demonstrate the versatility of the electrostatic DNA caging approach and provide a new pathway to nanoparticle modification with DNA that will empower further applications of these materials in medicine and materials science.

Metaplastic Breast Cancer: Current Understanding and Future Directions.

Metaplastic breast cancers (MBC) encompass a group of highly heterogeneous tumors which share the ability to differentiate into squamous, mesenchymal or neuroectodermal components. While often termed rare breast tumors, given the relatively high prevalence of breast cancer, they are seen with some frequency. Depending upon the definition applied, MBC represents 0.2% to 1% of breast cancers diagnosed in the United States. Less is known about the epidemiology of MBC globally, though a growing number of reports are providing information on this. These tumors are often more advanced at presentation relative to breast cancer broadly. While more indolent subtypes exist, the majority of MBC subtypes are associated with inferior survival. MBC is most commonly of triple-negative phenotype. In less common hormone receptor positive MBCs, hormone receptor status appears not to be prognostic. In contrast, relatively rare HER2-positive MBCs are associated with superior outcomes. Multiple potentially targetable molecular features are overrepresented in MBC including DNA repair deficiency signatures and PIK3/AKT/mTOR and WNT pathways alterations. Data on the prevalence of targets for novel antibody-drug conjugates is also emerging. While chemotherapy appears to be less active in MBC than in other breast cancer subtypes, efficacy is seen in some MBCs. Disease-specific trials, as well as reports of exceptional responses, may provide clues for novel approaches to this often hard-to-treat breast cancer. Strategies which harness newer research tools, such as large data and artificial intelligence hold the promise of overcoming historic barriers to the study of uncommon tumors and could markedly advance disease-specific understanding in MBC.

BCR-Net: A deep learning framework to predict breast cancer recurrence from histopathology images.

Breast cancer is the most common malignancy in women, with over 40,000 deaths annually in the United States alone. Clinicians often rely on the breast cancer recurrence score, Oncotype DX (ODX), for risk stratification of breast cancer patients, by using ODX as a guide for personalized therapy. However, ODX and similar gene assays are expensive, time-consuming, and tissue destructive. Therefore, developing an AI-based ODX prediction model that identifies patients who will benefit from chemotherapy in the same way that ODX does would give a low-cost alternative to the genomic test. To overcome this problem, we developed a deep learning framework, Breast Cancer Recurrence Network (BCR-Net), which automatically predicts ODX recurrence risk from histopathology slides. Our proposed framework has two steps. First, it intelligently samples discriminative features from whole-slide histopathology images of breast cancer patients. Then, it automatically weights all features through a multiple instance learning model to predict the recurrence score at the slide level. On a dataset of H&E and Ki67 breast cancer resection whole slides images (WSIs) from 99 anonymized patients, the proposed framework achieved an overall AUC of 0.775 (68.9% and 71.1% accuracies for low and high risk) on H&E WSIs and overall AUC of 0.811 (80.8% and 79.2% accuracies for low and high risk) on Ki67 WSIs of breast cancer patients. Our findings provide strong evidence for automatically risk-stratify patients with a high degree of confidence. Our experiments reveal that the BCR-Net outperforms the state-of-the-art WSI classification models. Moreover, BCR-Net is highly efficient with low computational needs, making it practical to deploy in limited computational settings.

Machine Learning Models for Predicting the Outcomes of Surgical Treatment of Colorectal Liver Metastases.

BACKGROUND: Surgical intervention remains the cornerstone of a multidisciplinary approach in the treatment of colorectal liver metastases (CLM). Nevertheless, patient outcomes vary greatly. While predictive tools can assist decision-making and patient counseling, decades of efforts have yet to result in generating a universally adopted tool in clinical practice. STUDY DESIGN: An international collaborative database of CLM patients who underwent surgical therapy between 2000 and 2018 was used to select 1,004 operations for this study. Two different machine learning methods were applied to construct 2 predictive models for recurrence and death, using 128 clinicopathologic variables: gradient-boosted trees (GBTs) and logistic regression with bootstrapping (LRB) in a leave-one-out cross-validation. RESULTS: Median survival after resection was 47.2 months, and disease-free survival was 19.0 months, with a median follow-up of 32.0 months in the cohort. Both models had good predictive power, with GBT demonstrating a superior performance in predicting overall survival (area under the receiver operating curve [AUC] 0.773, 95% CI 0.743 to 0.801 vs LRB: AUC 0.648, 95% CI 0.614 to 0.682) and recurrence (AUC 0.635, 95% CI 0.599 to 0.669 vs LRB: AUC 0.570, 95% CI 0.535 to 0.601). Similarly, better performances were observed predicting 3- and 5-year survival, as well as 3- and 5-year recurrence, with GBT methods generating higher AUCs. CONCLUSIONS: Machine learning provides powerful tools to create predictive models of survival and recurrence after surgery for CLM. The effectiveness of both machine learning models varies, but on most occasions, GBT outperforms LRB. Prospective validation of these models lays the groundwork to adopt them in clinical practice.

Advances in Artificial Intelligence to Diagnose Otitis Media: State of the Art Review.

OBJECTIVE: Otitis media (OM) is a model disease for developing, validating, and implementing artificial intelligence (AI) techniques. We aim to review the state of the art applications of AI used to diagnose OM in pediatric and adult populations. DATA SOURCES: Several comprehensive databases were searched to identify all articles that applied AI technologies to diagnose OM. REVIEW METHODS: Relevant articles from January 2010 through May 2021 were identified by title and abstract. Articles were excluded if they did not discuss AI in conjunction with diagnosing OM. References of included studies and relevant review articles were cross-referenced to identify any additional studies. CONCLUSION: Title and abstract screening resulted in full-text retrieval of 40 articles that met initial screening parameters. Of this total, secondary review articles (n = 7) and commentary-based articles (n = 2) were removed, as were articles that did not specifically discuss AI and OM diagnosis (n = 5), leaving 25 articles for review. Applications of AI technologies specific to diagnosing OM included machine learning and natural language processing (n = 23) and prototype approaches (n = 2). IMPLICATIONS FOR PRACTICE: This review emphasizes the utility of AI techniques to automate and aid in diagnosing OM. Although these techniques are still in the development and testing stages, AI has the potential to improve the practice of otolaryngologists and primary care clinicians by increasing the efficiency and accuracy of diagnoses.

Contrastive Multiple Instance Learning: An Unsupervised Framework for Learning Slide-Level Representations of Whole Slide Histopathology Images without Labels.

Recent methods in computational pathology have trended towards semi- and weakly-supervised methods requiring only slide-level labels. Yet, even slide-level labels may be absent or irrelevant to the application of interest, such as in clinical trials. Hence, we present a fully unsupervised method to learn meaningful, compact representations of WSIs. Our method initially trains a tile-wise encoder using SimCLR, from which subsets of tile-wise embeddings are extracted and fused via an attention-based multiple-instance learning framework to yield slide-level representations. The resulting set of intra-slide-level and inter-slide-level embeddings are attracted and repelled via contrastive loss, respectively. This resulted in slide-level representations with self-supervision. We applied our method to two tasks- (1) non-small cell lung cancer subtyping (NSCLC) as a classification prototype and (2) breast cancer proliferation scoring (TUPAC16) as a regression prototype-and achieved an AUC of 0.8641 ± 0.0115 and correlation (R2) of 0.5740 ± 0.0970, respectively. Ablation experiments demonstrate that the resulting unsupervised slide-level feature space can be fine-tuned with small datasets for both tasks. Overall, our method approaches computational pathology in a novel manner, where meaningful features can be learned from whole-slide images without the need for annotations of slide-level labels. The proposed method stands to benefit computational pathology, as it theoretically enables researchers to benefit from completely unlabeled whole-slide images.

A transformer-based deep-learning approach for classifying brain metastases into primary organ sites using clinical whole-brain MRI images.

Treatment decisions for brain metastatic disease rely on knowledge of the primary organ site and are currently made with biopsy and histology. Here, we develop a deep-learning approach for accurate non-invasive digital histology with whole-brain magnetic resonance imaging (MRI) data. Contrast-enhanced T1-weighted and fast spoiled gradient echo brain MRI exams (n = 1,582) were preprocessed and input to the proposed deep-learning workflow for tumor segmentation, modality transfer, and primary site classification into one of five classes. Tenfold cross-validation generated an overall area under the receiver operating characteristic curve (AUC) of 0.878 (95% confidence interval [CI]: 0.873,0.883). These data establish that whole-brain imaging features are discriminative enough to allow accurate diagnosis of the primary organ site of malignancy. Our end-to-end deep radiomic approach has great potential for classifying metastatic tumor types from whole-brain MRI images. Further refinement may offer an invaluable clinical tool to expedite primary cancer site identification for precision treatment and improved outcomes.

Attention2majority: Weak multiple instance learning for regenerative kidney grading on whole slide images.

Deep learning consistently demonstrates high performance in classifying and segmenting medical images like CT, PET, and MRI. However, compared to these kinds of images, whole slide images (WSIs) of stained tissue sections are huge and thus much less efficient to process, especially for deep learning algorithms. To overcome these challenges, we present attention2majority, a weak multiple instance learning model to automatically and efficiently process WSIs for classification. Our method initially assigns exhaustively sampled label-free patches with the label of the respective WSIs and trains a convolutional neural network to perform patch-wise classification. Then, an intelligent sampling method is performed in which patches with high confidence are collected to form weak representations of WSIs. Lastly, we apply a multi-head attention-based multiple instance learning model to do slide-level classification based on high-confidence patches (intelligently sampled patches). Attention2majority was trained and tested on classifying the quality of 127 WSIs (of regenerated kidney sections) into three categories. On average, attention2majority resulted in 97.4%±2.4 AUC for the four-fold cross-validation. We demonstrate that the intelligent sampling module within attention2majority is superior to the current state-of-the-art random sampling method. Furthermore, we show that the replacement of random sampling with intelligent sampling in attention2majority results in its performance boost (from 94.9%±3.1 to 97.4%±2.4 average AUC for the four-fold cross-validation). We also tested a variation of attention2majority on the famous Camelyon16 dataset, which resulted in 89.1%±0.8 AUC1. When compared to random sampling, the attention2majority demonstrated excellent slide-level interpretability. It also provided an efficient framework to arrive at a multi-class slide-level prediction.

Ki-67 assessment of pancreatic neuroendocrine neoplasms: Systematic review and meta-analysis of manual vs. digital pathology scoring.

Ki-67 assessment is a key step in the diagnosis of neuroendocrine neoplasms (NENs) from all anatomic locations. Several challenges exist related to quantifying the Ki-67 proliferation index due to lack of method standardization and inter-reader variability. The application of digital pathology coupled with machine learning has been shown to be highly accurate and reproducible for the evaluation of Ki-67 in NENs. We systematically reviewed all published studies on the subject of Ki-67 assessment in pancreatic NENs (PanNENs) employing digital image analysis (DIA). The most common advantages of DIA were improvement in the standardization and reliability of Ki-67 evaluation, as well as its speed and practicality, compared to the current gold standard approach of manual counts from captured images, which is cumbersome and time consuming. The main limitations were attributed to higher costs, lack of widespread availability (as of yet), operator qualification and training issues (if it is not done by pathologists), and most importantly, the drawback of image algorithms counting contaminating non-neoplastic cells and other signals like hemosiderin. However, solutions are rapidly developing for all of these challenging issues. A comparative meta-analysis for DIA versus manual counting shows very high concordance (global coefficient of concordance: 0.94, 95% CI: 0.83-0.98) between these two modalities. These findings support the widespread adoption of validated DIA methods for Ki-67 assessment in PanNENs, provided that measures are in place to ensure counting of only tumor cells either by software modifications or education of non-pathologist operators, as well as selection of standard regions of interest for analysis. NENs, being cellular and monotonous neoplasms, are naturally more amenable to Ki-67 assessment. However, lessons of this review may be applicable to other neoplasms where proliferation activity has become an integral part of theranostic evaluation including breast, brain, and hematolymphoid neoplasms.

History of the SPIE Medical Imaging Digital Pathology Conference.

The term "digital pathology" (DP) broadly refers to the process of digitizing glass whole-slide images (WSIs) using a digital whole-slide scanner as these WSIs are also used to render a diagnosis. Artificial intelligence (AI), on the other hand, is broadly defined as the application of machine-based algorithms to make a prediction, just like an intelligent human who has access to the necessary knowledge to make said prediction. Deep learning is a specific type of AI that has become very popular for the analysis and interpretation of DP images over the last decade because of the recent increase in computational power and advancements in whole-slide scanning. AI-enabled DP analysis of routine hematoxylin and eosin-stained tissues has shown increasing utility in characterizing complex tissue architecture to render disease diagnoses, prognoses, and predicting therapeutic response. A PubMed search for "digital pathology" yielded 310 hits in articles published in 2020; for those published in 2010, the same search yielded only 12 hits. The Digital Pathology Conference was initiated in 2011 by the authors (Drs. Madabhushi and Gurcan), two early pioneers in computational pathology, in anticipation of the expected explosion of research and clinical interest in this space.

Bioreactor design and validation for manufacturing strategies in tissue engineering.

The fields of regenerative medicine and tissue engineering offer new therapeutic options to restore, maintain or improve tissue function following disease or injury. To maximize the biological function of a tissue-engineered clinical product, specific conditions must be maintained within a bioreactor to allow the maturation of the product in preparation for implantation. Specifically, the bioreactor should be designed to mimic the mechanical, electrochemical and biochemical environment that the product will be exposed to in vivo. Real-time monitoring of the functional capacity of tissue-engineered products during manufacturing is a critical component of the quality management process. The present review provides a brief overview of bioreactor engineering considerations. In addition, strategies for bioreactor automation, in-line product monitoring and quality assurance are discussed.

Identification of difficult to intubate patients from frontal face images using an ensemble of deep learning models.

Failure to identify difficult intubation is the leading cause of anesthesia-related death and morbidity. Despite preoperative airway assessment, 75-93% of difficult intubations are unanticipated, and airway examination methods underperform, with sensitivities of 20-62% and specificities of 82-97%. To overcome these impediments, we aim to develop a deep learning model to identify difficult to intubate patients using frontal face images. We proposed an ensemble of convolutional neural networks which leverages a database of celebrity facial images to learn robust features of multiple face regions. This ensemble extracts features from patient images (n = 152) which are subsequently classified by a respective ensemble of attention-based multiple instance learning models. Through majority voting, a patient is classified as difficult or easy to intubate. Whereas two conventional bedside tests resulted in AUCs of 0.6042 and 0.4661, the proposed method resulted in an AUC of 0.7105 using a cohort of 76 difficult and 76 easy to intubate patients. Generic features yielded AUCs of 0.4654-0.6278. The proposed model can operate at high sensitivity and low specificity (0.9079 and 0.4474) or low sensitivity and high specificity (0.3684 and 0.9605). The proposed ensembled model outperforms conventional bedside tests and generic features. Side facial images may improve the performance of the proposed model. The proposed method significantly surpasses conventional bedside tests and deep learning methods. We expect our model will play an important role in developing deep learning methods where frontal face features play an important role.

Deep learning predicts gene expression as an intermediate data modality to identify susceptibility patterns in Mycobacterium tuberculosis infected Diversity Outbred mice.

BACKGROUND: Machine learning sustains successful application to many diagnostic and prognostic problems in computational histopathology. Yet, few efforts have been made to model gene expression from histopathology. This study proposes a methodology which predicts selected gene expression values (microarray) from haematoxylin and eosin whole-slide images as an intermediate data modality to identify fulminant-like pulmonary tuberculosis ('supersusceptible') in an experimentally infected cohort of Diversity Outbred mice (n=77). METHODS: Gradient-boosted trees were utilized as a novel feature selector to identify gene transcripts predictive of fulminant-like pulmonary tuberculosis. A novel attention-based multiple instance learning model for regression was used to predict selected genes' expression from whole-slide images. Gene expression predictions were shown to be sufficiently replicated to identify supersusceptible mice using gradient-boosted trees trained on ground truth gene expression data. FINDINGS: The model was accurate, showing high positive correlations with ground truth gene expression on both cross-validation (n = 77, 0.63 ≤ ρ ≤ 0.84) and external testing sets (n = 33, 0.65 ≤ ρ ≤ 0.84). The sensitivity and specificity for gene expression predictions to identify supersusceptible mice (n=77) were 0.88 and 0.95, respectively, and for an external set of mice (n=33) 0.88 and 0.93, respectively. IMPLICATIONS: Our methodology maps histopathology to gene expression with sufficient accuracy to predict a clinical outcome. The proposed methodology exemplifies a computational template for gene expression panels, in which relatively inexpensive and widely available tissue histopathology may be mapped to specific genes' expression to serve as a diagnostic or prognostic tool. FUNDING: National Institutes of Health and American Lung Association.